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Image Processing System 

The invention relates to an image processing system in which a linear array of 
detectors is swept over a scene to provide a two dimensional display. 

5 

Bacl<ground . 

Examples of these systems are in thermal imaging where a parallel array of detectors 
Is scanned across a scene by rotating prisms and/or flapping mirrors. Usually these 

1 0 detectors are also given a vertical scan, and the resultant display is formed of a 
plurality of banded scans. One use of imaging systems is in traffic monitoring. For 
example checking on the number and type of vehicles passing onto a bridge, toll 
road, or city centre congestion monitoring. One example is described in GB 2154388, 
where a single fixed vertically arranged linear array of detectors monitors vehicles 

15 passing through the detectors field of view. Movement of the vehicles provides a 
horizontal scanning giving a two dimensional image that can be stored or transmitted 
to a remote location. 

The above example has its limitations; it does not distinguish between opposite 
20 directions of movements and can not give information about movement away from the 
sensors. 

This limitation is overcome, according to this invention, by the use of a plurality of 
vertically arranged detector arrays and comparison of signals received from ^ach 
25 array. 
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Accordlng to this invention an image processing system includes a linear array of 
detectors imaged onto a scene of interest and a signal processor for storing an image 
received by tiie linear array when a detected object passes through the scene; 

5 charactensed by: 

a plurality of linear arrays spaced substantially parallel to one another to Image a 
plurality of areas of interest in a scene; and 

1 0 signal processing for detecting images received by the plurality of arrays and 
determining direction and speed of movement detected. 

Additionally the system may detect size, type, and movement towards or away from 
the detector arrays. 

15 

The detectors may be sensitive in the infra red (IR), microwave (including mm wave 
devices), or visible wavebands, operating with ambient or artificial illumination. In 
some application a combination of IR and visible detectors may be used. The IR \ 
detectors may be uncooled resistance bolometer or pyroelectric detectors. ' 
20 ^ j 

Preferably each detector in the linear array has an associated amplifier and fitter. 

i 

Several systems may be combined into a single unit and arranged to give 360*" . | 

azimuthal coverage. | 

25 . I 
For most application the linear arrays will be arranged vertically, and movement of a j 
target Is horizontal through the scene. However, these are optimum relative i 
conditions and the array alignment and target movement may depart substantially | 
from these. It is however necessary that the target movement has a component j 

30 orthogonal to a linear arrays alignment direction. j 

i 

i 

i 
I 

L 

I 
t 

1 
J 



Brief description of drawings. 



Tlie invention will now be described, by way of example only, with reference to the 
accompanying drawings in which: - - 

Figure 1 is a schematic view of a single vertical detector array monitoring traffic along 
a road; 

Rgurfe 2 is a view of both a two-dimensional .array with amplifiers, and four vertical 
linear detector arrays with a separate amplifier associated with each detector 
element: 

Rgure 3 is a schematic view of a multiple linear detector array and lens formed by 
four anrays; 

Rgure 4 is a plan view of a four array system and shows images of a vehicle moving 
through four detector array fields and away from the detectors, thus the images get 
smaller on successive detections: 

Rgure 5 is a block diagram of a processor for processing of the detector arrays; 

Rgure 6 is a view of four vertical linear arrays arranged in pairs; 

Rgure 7 is a view of two pairs of vertical linear arrays used to trigger an additional 
two-dimensional array of detectors; 

Rgure 8 is a plan view showing four separate arrays of four vertical linear arrays for 
providing 360** azimuthal detection; 

Rgure 9 is a flow chart showing an algorithm for the processing of a single linear 
array; and 

Rgure 10 is a flow chart showing an algorithm for processing for automatic target 
vailidation. 
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Description of embodiments. 

Rgure 1 shows the principles involved in a single vertical detector array 1 monitoring 
vehicles 2 movement along a road 3. The vertical array 1 receives an image 4 via a 
5 lens 5; typically the number of detectors in an array is 64 in a range of 32 to 128 or 
more. The image 4 is a thin strip 4 of detail from the vehicles 2 moving along the 
road 3. Successive images 4 are fed into memory 6 of a processor 9 for processing. 
The width of the stored image from a single vertical array 1 is dependent upon the 
speed of the vehicle 2 along the road and sampling speed of the array 1 , typically 
10 between 5 and 50 times a second. Without vehicle movement no image is recorded if 
the detectors are pyroelectric detectors; such components measure temperature 
changes only (i.e. A.C. coupled), not steady state temperatures. Other forms of 
detectors, e.g. photodiodes or resistance bolometers respond to a steady-state input 
(i.e. D.C. Coupled). 

15 

Rgure 2 shows four vertically arranged linear arrays manufactured in a sparse 
manner on a substrate 8 with room between each array for a column of electronic 
filters and amplifiers, with one amplifier and filter for every detector element. Readout 
electrodes 1 0 enable the output from each detector element to read out sequentially 
20 in a multiplexed manner. In comparison, a 2-d close packed array 1 1 is also shown 
with a set of amplifiers and filters 1 2. 

The linear array 1 fomnat has a distinct advantage over two-dimensional arrays 1 1 in 
terms of the signal/noise ratio that can be achieved. In a close packed array 1 1 there 

25 is no opportunity to limit the noise bandwidth until the signal has been multiplexed so 
the minimum noise bandwidth is the product of the frame rate and the number of 
pixels in a column. With a linear array 1 there is space to filter the signal from each 
pixel before multiplexing, which reduces the noise bandwidth and thus improves the 
signal/noise ratio. This may typically be achieved using compact low-power switched- 

30 capacitor filters, which can be readily implemented in CMOS technology. The array 
must be read out at sufficient speed that any target is sampled with sufficient 
resolution. 



0 



0 



Each detector element may be made as described in WO/GBOO/03243. in such a 
device a micro bolometer is formed as a micro-bridge in which a layer of e.g. titanium 
is spaced about 1 to 2fjm from a substrate surface by thin legs. Typically the titanium 
is about 0.1 to 0.25;/m in a range of 0.05 to Q.Znm with a sheet resistance of about 
3.3Q/sq in a range of 1 .5 to 6Q/sq. The detector microbridge is supported under a 
layer of silicon oxide having a thicl<ness of about A/4 where A is the wavelength of 
radiation to be detected. The titanium detector absorbs incident infra red radiation (8 
to Um wavelength) and changes its resistance with temperature. Hence measuring 
the detector resistance provides a value of the incident radiation amplitude. 

Figure 3 shows a schematic view of a system using four vertically arranged linear 
detector an^ys 1 a-d for use as in Figure 1 ; more or less arrays may also be used. 

Figure 4 shows a system with four linear arrays la-d. as in Figure 3. marked A. B. C. 
D with a target object 13 moving successively through each detector beam with 
Increasing distance away from the sensor an-ays. Images 1 4 from each array are 
also shown; note that a vehicle's image becomes smaller as it moves away from the 
array. This allows the processor to estimate both radial movement and movement 
across the four arrays, i.e. calculate direction and speed of a target. 

A block diagram of a processor for. processing the output from a linear array is shown 
In Rgure 5. Image from a scene is focussed onto all detectors in an array as in 
Rgures 1 . 3. Output is read sequentially from each linear array 1 via electrodes 1 0 
Into an A/D converter 16 and passed into a cpu digital processor 17. This cpu 17 
canies out several steps as described later (Figures 9. 10). and also feeds into an 
image memory store 18. and Into a communication module 19 whose output may be 
via landllnes or radio to extemai receiving stations (not shown) to operators reading 
video monitors or to automatic detection systems. 



m 
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When operated as part of a larger system, the vertical array sensor format can be • 
optimised for use In cueing other higher resolution 2-d imagers. The timing and 
positional information supplied by the sensor gives an additional cue for the location 
of the target at a given moment in time, see Figure 7. In this case one or nnore vertical 
5 arrays could monitor the perimeter of the central area of interest, and a sensor fonnat 
as shown in Figure 6 would be more appropriate where the vertical arrays have been 
constructed with a wider gap between the central pair. 

The purpose of using a linear array to cue another higher resolution 2-d imager Is to 
1 0 reduce power consumption and enable coverage of a wider area than could be 

achieved with the high-resolution imager operating alone. In a system like this the 2-d 
imager only needs to operate for short periods of time when a target has been 
detected. This particularly important where it is also necessary to switch on artificial 
illumination in order for the 2-d array to provide a high quality image. The application 
1 5 of simple false alarm reduction techniques to the output of the vertical array can 
further reduce the number of occasions when the 2-d imager is cued. This reduction 
in power consumption is necessary for sustained operation of distributed sensor 
networks. It also allows a high-resolution imager with narrow field of view when • 
mounted on a pan and tilt head to be cued by the processor to look at appropriate ! 
20 areas of interest, achieving hlgh-resolutibn coverage of the area of interest within a 
wider field of \flew. 

Extended coverage may be arranged by use of three or more systems. This is shown j 
in Figure 8 which shows a plan view of four systems, as in Rgures 3, 4, arranged 90° i 
25 apart to give all round azimuthal coverage. Increasing the number above four 1 
improves perfonmance at the expense of further complexity. \ 

Rgures 9 and 10 show an example of a simple digital processing sequence that could I 

process and interpret the data from these vertical arrays. The process shown in \ 

30 Figure 9 outlines how movement is detected, false or spurious targets ignored and an j 

image of the target constructed In memory for a single vertical array. The process \ 

shown in Figure 1 0 outlines the order in which this image would be classified, the J 

images from all of the vertical arrays in a sensor compared, and the range, speed and j 

air§ctionai imormation aerivecrfrom the combined information supplied by all of the [ 

35 arrays. 



5 



As can be seen It is practical to Implement a simple analysis of tlie incoming data to 
reduce or eliminate false targets and spurious noise and clutter in the scene. Hence 
movement through the scene can be detected and targets of interest validated. 
Following this, further processing can classify the target and determine range, 
direction of movement, speed and finally an estimate of the true direction of travel. 

Once in the memory 18 the image shape can be compared to stored standard 
templates of the typical imagery of vehicles and people as seen at the operating 
waveband of the detectors. In this manner the target can be classified as vehicle or 
personnel, and if a vehicle then the type of vehicle can be determined e.g. car, mini- 
van, truck, tractor, tank. The type of vehicle must be determined for the actual height 
of the target to be known and to enable the range, speed and directional information 
to be calculated. 

By comparing the apparent height of the target image against the Jcnown typical 
height of tliis class of target the distance of the target from the llnear.arrays 1 can be 
calculated. 



The time delay between the arrays In detecting the target and the now known 
distance to target can be used to calculate an estimate of the speed of the target. 

As more than one vertical array is used further Information can be obtained with 
regard to the target by tracking the target as it is detected consecutively by all of the 
arrays and comparing the outputs from each array against one another. For example, 
the direction of travel (e.g. either left-to-right or right-to-left) can be determined based ' 
on which array detects the target first. 



And finally an estimate of the true direction of travel can be obtained by comparing 
the apparent size of the target in the Images from each of the linear arrays and their 
-relative timing. 
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Claims. 

1 . An Image processing system including a llnear.array of detectors (1) imaged onto 
a scene of interest and an image store for receiving signals from tlie linear array 
5 when a detected object (2) passes through the scene; 

characterised by: 

a plurality of linear arrays (1a-d) spaced substantially parallel to one another to image 
10 a plurality of areas (4) of interest in a scene; and 

a signal processor (7, 16, 17, 18) for detecting images received by the plurality of 
arrays and determining direction and speed of movement detected. 

15 2. The system of claim 1 wherein the detectors (1) are infra red detectors. 

3. The system of claim 1 wherein the detectors (1) are visible light sensitive 
detectors. 

20 4. The system of claim 1 wherein the detectors (1) are mm wave sensitive detectors. 

4. The system of claim 1 wherein each detector element in each array (1) has 
associated therewith an independent amplifier and filter (9). 

25 5. The system of claim 1 wherein each detector array (1 ) has its output read out (1 0) 
sequentially from each detector element 

6. The system of claim 1 wherein the processor (7) is arranged to determine at least 
one of detected object range, direction of movement, speed, true direction of travel, 
30 object type. 
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7. The system of claim 1 including an additional two-dimensional detector array 
system (11,12) which may be switched on when an object (2) is detected. 

8. The system of claim 1 wherein several systems are combined into a single unit - 
5 arranged to give about 360° of azimuthal coverage. 

8. The system of claim 1 wherein outputs from the signal processor are 
communicated to remote monitoring stations. 

10 10. The system of claim 1 wherein the processor performs the algorithm of at least 
Figure9or Rgure 10. 
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Abstract. 

An image processing system includes a plurality of vertically arranged linear arrays 
(1a-d) of detectors imaged onto a plurality of areas (4) in a scene of interest. 
Horizontal movement of an object (2) through the plurality of areas of interest are 
detected and fed into a processor (7). The processor may detect object range, 
direction of movement, speed, true direction of travel, object type. 

The detectors may be sensitive in the infra red (IR), microwave (including mm wave 
devices), or visible wavebands,- operating with ambient or artificial illumination. In 
some application a combination of IR and yisible detectors may be used. Preferably 
each detector in the linear array has an associated amplifier and filter. 

A 360° cover may be obtained by combining several systems into a single unit. 

The system may be used to detect objects and then control operation of a higher 
definition two-dimensional detector array and camera (1 1,12). 



Figure 1 to accompany the Abstract. 
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Image frame from ^rst linear 
array to detect target 



r 



Once validated as a 
genuine target, J 
classify and identify*^ 
the target image 



r 



Track the target as 
it is detected 
consecutively by all 
of the arrays and 
compare the output 
of all arrays. 

Thus calculate 
range, speed and 
approximate 
direction of travel 



{ 



Classify target image as personnel or vehicle 



V 



If Vehicle 



If Personnel 



J2- 



If neither 



Compare outline of target 
image against standard 
templates, Identify vehicle 



Calculate number of 
individuals 



i 



Calculate range from ratio 
of apparent image height 
against known height of 
this vehicle type 



Calculate range from ratio 
of Image height of single 
individual against height of 
typical person 



Compare & correlate valid target data from all of the arrays to 
track the target between the arrays & determine which image 
frame from each linear array is associated with this target 



Calculate speed from the rs 
in detection by the individuc 


r 

mge and the time delay 
il Linear arrays 
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Calculate direction of travel from both the time 
delay & image height differences between the • 
linear arrays 
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Calculate speed from the range and the time delay 
in detection by the Individual Linear arrays 


'I 


r 


Alert user to presence of a target that is valid and 
classified by type, and output type, speed etc 



If the image frame does 
not match any standard 
templates, e.g. horse 
unable to identify so 
classify as unknown type 



Alert user to presence of a 
possible target 



Figure 10 - Flow chart of Digital Processing for Automatic Target validation 
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Calculate & 
maintain mean 
background 
scene when no 
target present 
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Does variation in line 
data indicate the 
presence of a targets 



Ignore random noise or 
movement of small 
objects 
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Detect movement, 
validate & store 
image of target 
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Build up Image of 
possible target In 
memory 



Does variation in line 
data continue to 
Indicate presence of a 
target? 

Timeout to end 
loop e.g. vehicle 
parks In front of 
array 

Does the image 
appear to be a solid 
target or broken up? 



Sample Unear array, store single line at start of 
scene memory 



Update mean reference 
line of background with 
current line data 



Compare current line data to the mean background 
scene. Is variation between cunrent and reference 
line > threshold AND for more than n pixels? 



No 
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Yes 



Are at least 3 of the pixels that are detecting a 
change in the scene adjacent to one another? 



No 



Yes 



Start Timer. Record start time of current target 
detection. 



Sample Unear an^ay, add to imagery by storing new 
line at next location in scene memory J 



Compare to mean background scene. Is variation 
between cunrent and reference line > threshold for 
more than n pixels? _^ 



No 



res 



Timeout, is Timer value > Timeout period 
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Yes 



Are at least 30% of pixels in current line that show a 
si qpal variation the same pixels as those in the 
previous line that showed signal variation, i.e. we 
are viewing a solid continuous target, not spurious 
noise? 



No 



End of target 
detected 



Detect end of target. Build image frame [start & end 
addr In memory/time stamp] & pass to next stage 



Pass Image frame to next stage of 
processing to compare against 
output from the other linear anays 



Figure 9 - Flow chart of Digital Processing For a Single Linear Array 
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